-
Notifications
You must be signed in to change notification settings - Fork 73
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[WeeklyReport] fxfxfxfxfxfxfxfx 2024.08.12.~2024.08.25 #354
[WeeklyReport] fxfxfxfxfxfxfxfx 2024.08.12.~2024.08.25 #354
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
1. 将qwen2moe SparseMoEBlock改成自动并行版本 | ||
2. 编写单元测试 | ||
|
||
### 导师点评 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
尽量在不改动源代码逻辑下实现自动并行版本
|
||
1. 将qwen2moe SparseMoEBlock改成自动并行版本,尽量少改动原本的代码,最大化利用自动并行相关api的功能。 | ||
|
||
### 导师点评 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
熟悉代码中专家并行的实现原理和流程,有助于修改代码和排查问题
注意: 请将周报 PR 按以下格式命名: